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ABSTRACT 



The object of this study is to find an approximation to the discrete 
optimal Kalman filter gain schedule by closed-form analytic expressions. 

In doing so, required table storage and/or on-line computation time can 
be reduced at little expense in terms of filter performance degradation. 

The method of least squares was used to determine the closed-form solution 
which was the best fit to the discrete Kalman filter gain schedule. The 
criterion for performance degradation was the difference between the val- 
ues of the diagonal elements of the estimation covariance matrix, 
obtained by using the Kalman gain schedule, and the corresponding values 
obtained by using the closed-form analytic expressions for the elements 
of v the gain matrix. Examples are presented to show that near-optimal 
results were obtained utilizing this method. A comparison of the results 
of this study with another near-optimal estimation scheme is also included. 
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TABLE OF SYMBOLS AND ABBREVIATIONS 



SYMBOL 


DIMENSION 


X 


(n*l) 


vector 


A 


(n*n) 


matrix 


B 


(n*p) 


matrix 


u 


(p*D 


vector 


w 


(p*l) 


vector 


£ 


(m*l) 


vector 


H 


(m*n) 


matrix 


z 


(m>l) 


vector 


V 


(m*l) 


vector 


1 


(n*n) 


matrix 


P k/k 


(nxn) 


matrix 


P k/k-l 


(nxn) 


matrix 


G k 


(nxm) 


matrix 


Q 


(n*n) 


matrix 


R 


(n<m) 


scalar 


N 


(p*p) 


scalar 


I 


(nxn) 


matrix 



NAME 

System state variables 
System matrix 
Distribution matrix 
Deterministic forcing functions 
Random forcing functions 
System outputs 
Measurement matrix 
System observables 
Random measurement noise signals 
State transition matrix 
Estimation covariance matrix 
Prediction covarianc3 matrix 
Gain matrix 

Covariance of perturbation matrix 
Measurement noise covariance 
Random force covariance 
Identity matrix 



LAPLACE DEFINITIONS 
|(t) = i" 1 [(sI-A)“l| 

rct> = to [to, - B 
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I. INTRODUCTION 



The theory of optimal estimation has undergone considerable investi- 
gation in recent years [}*>2 5 9, 11,12] . 

The objective of estimation is the 

production, in some optimal way, of estimates of the state vector, which 
is denoted by x , from some set of observations, denoted by . In the 
early 1960 f s, R. E. Kalman initiated a new formulation of the Wiener 
filter theory expressing the results in the time domain rather than the 
frequency domain . 

The vector dynamic case of the linear filtering equation can be 
stated by 



* k/k ~ k/k-1 + G k ^k/k-J 



( 1 ) 



where x, „ is the estimate of x. . Kalman found that the optimal estimate 
-k/k ~ k 

x . , in a minimum-variance sense, could be obtained by solving the dif- 
— k/k 



ference equations 



G = P , 
k k/k* 



- T r 

-i L 



"W-/ + R 



O ' 1 



( 2 ) 



P k/k = (I - GH)P k/k-l 



(3) 



W ' K/ki T - « 



(4) 



with ” VAR |” Xq and Xq = The definitions and dimen- 

sions of the matrix quantities in the above equations may be found in the 



Table of Symbols and Abbreviations. 

It is obvious that, in order to solve for successive values of x , 



■k/k 



in equation (1) , it is necessary to solve equations (2) , (3) , and (4) 
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recursively. This process involves a considerable number of matrix mani- 
pulations. Consequently the on-line computation time would be large. Also 
considerable storage space would be needed if the problem were to be redone 
at a later time, utilizing the same matrix of gains. This estimation 
scheme requires the implementation of -- difference equations 

or an n order system of which 11 — are non-linear. For large-order 

systems, this scheme may be of such complexity that it is undesirable for 
a given application. 

If it were possible to derive an analytic closed-form expression which 
would approximate the optimal Kalman filter gain schedule with acceptable 
degradation of filter performance then on-line computation time would be 
greatly decreased since no matrix manipulations would be necessary. Also, 
the need for table storage of the gains, G^, would not be necessary since 
it would be a simple matter to calculate them again when they were needed. 
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II. THEORY 



Appendix A illustrates that, according to the criterion of least 
squares, the best fit curve to a set of data is one in which the sum of 
the squares of the errors of the points is a minimum. The method used to 
obtain this best fit curve is known as the Method of Least Squares. 

If this method can be used to produce a curve which is the best fit, 
in a least-squares sense, to the set of optimal gains, then the equation 
for that curve would be a sub-optimal closed-form solution for those 
gains . 

Therefore, all that is necessary to produce a candidate closed-form 
analytical approximation for the optimal Kalman filter gain schedule is 
to fit a least squares curve to the set of optimal gains. 

Observations of typical optimal Kalman filter gain schedules indi- 
cated that these gains would most likely be best fit with exponential 
curves. In order to take advantage of existing computer programs on least- 
squares curve-fitting it is necessary to convert the exponential form to 
a linear form. Appendix A illustrates the method by which this transfor- 
mation was made. Once the transformation to a linear form has been made 
the method of least-squares curve-fitting can be applied and the results, 
through an inverse transformation, can be used to obtain the desired ex- 
ponential expressions . 

Equations (2), (3), and (4) reveal that the solution for the optimal 
gain matrix depends on the quantities H, R, (ji and Q where 

Q = TN r T (5) 

and N is the random force covariance associated with the particular prob- 
lem. The definitions and dimensions of these quantities may be found in 
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the Table of Symbols and Abbreviations. In order to reduce the complexity 
of the system, for that is the basic goal of this study, some simplifying 

assumptions are made. It is necessary to initialize the prediction co- 
variance matrix P^/lc-l’ ^he diagonal elements of this matrix indicate 
the confidence given to the initial filter state vector. It will be as- 
sumed that little confidence is given, thus the diagonal elements of 
Pq/_ 1 will be large. The off-diagonal elements indicate to what extent 
the initialization errors of the filter states are dependent. It will be 
assumed that they are independent and thus the off-diagonal terms of 
Pq/ i will be zero. 

It is also assumed that the measurement matrix, H, the state trans- 
mission matrix, $, and the P matrix, which is used to compute the co- 
variance of perturbation matrix, Q, are constant for a given plant. That 
is to say that once these quantities are known for a specific process or 
plant, they remain unchanged during the operation of the plant or process. 

Thus, once the nature of the plant or process is known, the only 
variables involved in the determination of the optimal gain matrix are the 
measurement noise variance, R, and the random force variance, N. These 
quantities will be assumed constant in time for a given problem, but may 
vary from problem to problem. 

With these assumptions it is possible to develop closed-form expres- 
sions for the elements of the gain matrix in terms of the quantities R 
and N. 
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III. PROCEDURE 



As stated above the object of this study is to develop a method for 
finding a sub-optimal closed-form analytic expression for the optimal 
Kalman filter gain schedule which would be easier to implement and reduce 
required table storage and/or on-line computation time while keeping fil- 
ter degradation to a minimum. 

The best way to present the method of this study is to follow an 
illustrative example which demonstrates the technique used to obtain the 
desired results. Note that this method is designed to be used with a 
plant or process which has a known, non-variable configuration, with the 
only variables being the measurement noise variance, R, and the random 
force variance, N. 

The problem discussed for purposes of demonstration will be one where 
the motion of a mass particle in one dimension is considered. The ob- 
server will initialize the problem by indicating when he sees the particle 
pass a zero point. Subsequent measurements of the particle ! s position 
will be made at a period of T seconds as measured by a clock. The filter 
then must produce minimum variance estimates of the particle 1 s position 
and velocity at discrete times kT where k £ 0. 

The system state variables chosen were position and velocity. The 
vector matrix form of the state equations can be expressed as 




Assuming that the random forcing function, f, is piecewise constant, and 
recalling the definitions of $(T) and P (T) given in the Table of Symbols 
and Abbreviations, the solution of equation (6) is given by 
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where 



}«) .[j 3 



( 8 ) 



and 



ra) = i/m 




2 

T 



(9) 



Since only measurements of position are made the measurement matrix is 
given by 

H = [l C[) . (10) 

From equation (5) the covariance of perturbation matrix, Q, is given by 

Q “ N/ M 2 



l 4 T 3 

4 2 

l 3 x 2 
2 



(ID 



Next the problem must be initialized. Assuming that the observer 
signals when he thinks that the particle is initially at a position zero 
and also assuming his guess of the particle's velocity to be 10.0 units/ 
sec., the filter's initial state vector is 



- 0/-1 




( 12 ) 



As discussed above, when initializing the prediction covariance matrix 
it is necessary to consider how much confidence is given to the values of 
the observer’s eye-sight and reflexes as well as his ability to estimate 
the particle’s initial velocity. Being distrustful of his ability the 



initial covariance matrix becomes 



The diagonal elements indicate the lack of confidence in the initialization 
of the state vector of equation (12). 

Assuming a value of unity for the mass of the particle, values of R 
and N may be chosen and the optimal gain schedule for the Kalman filter 
may be found using equations (2) through (4). 

The problem to be considered now is how to achieve a closed-form 
analytic approximation for G^. so that equation (1) may be solved to ob- 
tain estimates of x, . 

— k 

Before going further a quantity to be known as the pseudo signal-to- 
noise ratio of the system must be defined. This signal-to-noise ratio 
is defined as N/R where 



N - E Ia 4 ] 

and 

R - E k<l . 



(14) 



(15) 



To make this signal-to-noise ratio a scalar quantity it must be stipu- 
lated that the random measurement noise signal, v , and the random fore- 

ing function, w , are scalar quantities for this problem. Thus the quan- 
~k 

tity N/R is a scalar measurement of the signal-to-noise ratio of the 
system. 

The example problem, with initial conditions as shown above, was run 
for various values of the signal-to-noise ratio N/R. Fig. 1 and Fig. 2 
show a family of curves for the gain matrix elements G(l,l) and G(2,l) 
repsectively and the associated signal-to-noise ratio of each. As stated 
earlier it was decided that the points of G(l,l) could best be approxi- 
mated by the sum or difference of two exponentials. Using the method 
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illustrated in Appendix A of reducing an exponential to linear form it 
was a simple matter to take the logarithms of the points and obtain a least- 
squares fit curve for each set of points. The curves obtained as well as 
the equations for these curves are found in Fig. 1 and Fig. 2. 

Steady-state gain as a function of s ignal-to-noise ratio is plotted 
in Fig. 3. These plots indicate that the steady-state gains also behave 
in an exponential manner with respect to the signal-to-noise ratio. Fur- 
ther investigation showed that the exponents of the equations in Fig. 1 
and Fig. 2 behave in a like manner. Using the same method as discussed 
above, closed-form solutions for these quantities were developed in terms 
of the signal-to-noise ratio N/R. The analytical closed-form solution 
and its related equations are called the sub-optimal equations. These 
appear in equations (4.1) through (4.9) of Appendix B. 
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IV. RESULTS 



Once the closed-form analytic approximation for the gain matrix, G , 

K. 

is found it is an easy matter to test the results against the recursive 
equations of the optimal Kalman filter. Since the Kalman filter gains are 
optimum in a minimum-variance sense it is necessary only to compare the 
diagonal elements of the matrix obtained using the closed-form sol- 
ution for with the respective elements of the matrix obtained 

using the optimal Kalman filter gain schedule. 

Since the gains obtained from the solution of the closed-form equa- 
tions are non-optimal, equation (3) may not be used. Instead it is ne- 
cessary to derive a general equation for all values of obtained with 

other than optimal gains. Such an equation has been derived M which can 
be expressed as 



\/k - p k/k-i- G k“ , k/k-i HTG k + G k (Hp k/k-i« T - . < i6 > 

Figures 4 and 5 show the comparison of the diagonal elements of P^^ 
for the optimal case and those for the case where G ^ was determined by 
the closed-form expressions developed. These figures indicate that the 
values obtained using sub-optimal gains are higher than the optimal val- 
ues. To determine how much this difference affects the estimation capa- 
bilities of the filter this problem was simulated and a comparison was 
made between the actual value of velocity for the point and the estimated 
value of velocity for both the optimal and sub-optimal case. Figure 6 
indicates that, for this problem, the estimating capabilities of the 
optimal and sub-optimal filters are similarly effective. 
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V* COMPARISON OF RESULTS WITH A PREVIOUS STUDY 



Sims and Mel s J have reported on attempts to achieve, for the con- 
tinuous case, near-optimal estimation using a structure which is easier 
to implement than the optimal Kalman solution. Their method, called 
Specific Optimal Estimation, is described in Ref. 13. The following is 
an attempt to adapt their methods and results for the continuous case to 
the discrete case. 



A. THE DISCRETE LINEAR PROBLEM 

Consider the linear message model 

x = fx. + r u 

— k+1 k — k 

with observation model 



•?k 



Hx + v 
-k -k 



where u and v are white noise processes such that 



e [s k 41 ■ Q 
e *3 - * 

E §* J ■ ° 

E 0*0 ' E [-J ■ 0 



(17) 



(18) 



(19) 



The optimal linear minimum variance estimate, x , of the state 

“k/k 

vector x^_ is given by 



-k/k 



x , + G T z, -z, ,~1 

— k/k-1 k Irk — k/k-lj 



( 20 ) 
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where 






( 21 ) 




P k/k = 



( 22 ) 



p k + i/k ■ * p k/k* T + a 



( 23 ) 



and P 



0/-1 



« VAR 



[v^o] ; 





the same form as equation (20), but with the gain matrix, G^, constrained 



where a is a constant-parameter vector to be determined optimally and D 
is a matrix of initial conditions which may or may not be determined opti- 
mally. 

Let x, = x, -x, be the estimation error, and assume that the obser- 
-k -k — k/k 

vation interval be discrete. The error criterion used is 



to be of a specific configuration. In particular, G^, is assumed to be 
the solution to the difference equation 



G k - F(k,a) G q = D 



( 24 ) 




( 25 ) 



This may be written as 



T 




J = tr i 



( 26 ) 



k = 1 



Making use of the definition 




( 27 ) 
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equation (26) can be written 



J = tr ^ 

k = 1 



k/k 



( 28 ) 



The problem then is to determine the parameters in the equation of 
such that J is minimized. If it is assumed that the estimate, x^/^* 
of the form specified in equation (20) it is easy to verify that satis- 

fies the difference equation 

P k/k - P k/k-l-G k HP k /k-l HlG k + G^HP^H 1 + K)G P 



(29) 



Sims and Melsa determined the parameters in the equation for G^ which 
minimized equation (28) by developing the Hamiltonian for deter- 

mining the equations for the Lagrange multiplier matrices, and obtaining 
the solution by solving the problem as a two-point boundary problem with 
appropriate boundary conditions. 

Since the equation for P^./^ a difference equation, in the discrete 
case, rather than a differential equation, this approach cannot be used. 
One might solve equation (29) recursively with equation (4) for all val- 
ues of k in the summation, and set the derivative with respect to the 
undetermined parameters of G equal to zero to determine the gains which 

1C 

would minimize equation (28), but an inspection of this method by the 
author revealed that this would be too tedious. The approach adopted 
here, although being equally tedious, lent itself to a computer solution. 
This approach involved setting the gain matrix to a constant in equation 
(29) and evaluating the cost function of equation (28) . One element of 
the gain matrix was held constant and the other was varied until a mini- 
mum value for J was found. The element of the gain matrix which had 
been held constant was then incremented and the procedure was duplicated. 
As a result Fig. 9 was obtained. The verticle lines are proportional to 
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the value of the cost function at each local minimum shown. The coordi- 



nates of the base of each verticle line are the values of G(l,l) and G(2,l) 
which gave the value of the cost function shown. The values of gain at 
which the cost function reached its absolute minimum were G(l,l) = .852 
and G(2,l) = .466. These are compared with the optimal steady-state val- 
ues of G(l,l) = .700 and G(2,l) = .400. Using the values of gain obtained 
above the illustrative problem was run and the results are presented in 
graphic form in Fig. 4 and Fig. 5. 

Note that the gains obtained above were close to the steady-state 
values of the optimal gain matrix. It would be expected that these gains 
would become closer to the optimal steady-state values as the number of 
samples increases. To show this the solution was performed again for ten 
samples, vice twenty. The values of the gain matrix for minimum cost ob- 
tained were G(l,l) « .902 and G(2,l) = .516. Thus, with a smaller number 
of samples, the sub-optimal constant gains are further from the steady- 
state optimal gains. 
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VI. CONCLUSIONS 



It is evident from Fig. 4 through Fig. 6 that the Kalman-type filter 
utilizing the closed-form equations for sub-optimal gains performs in a 
near-optimal manner with little degradation in the performance of the 
filter. The question now arises as to whether this method of determining 
the filter gains does fulfill the objective of this study; that is, has 
required table storage and/or on-line computation time been reduced? A 
comparison of equations (4.1) and (4.2) of Appendix B with equation (2) 
above indicates that the former equations are easily and quickly solved 
for all values of k, once the signal-to-noise ratio, N/R, is determined, 
while in the latter equation it is necessary to perform four matrix pro- 
ducts, two transposes, and a matrix inversion in order to solve for one 
value of the gain matrix. In order to solve this equation for all values 
of k it is necessary to solve equations (3) and (4) recursively along with 
equation (2). This procedure requires four additional matrix products, 
an additional matrix transpose, and a matrix addition and subtraction in 
order to obtain each additional value for the gain matrix. Thus the 
closed-form gain equations will greatly reduce on-line computation time. 

This same argument can be used to show that required table storage 
has also been reduced. Assume, for instance, that a problem is to be 
performed over again at a later time. In the case of the Kalman filter 
it is necessary to store the gain schedule, since it would be too costly 
in on-line computation time to re-compute the schedule. Since the closed- 
form equations are much more quickly solved it is not necessary to store 
the values of gain obtained in this manner. 
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Recall that it has been assumed that all factors which influence the 



gain matrix are to be constant from problem to problem, with the exception 
of the scalar measurement-noise covariance, R, and the scalar random-force 
covariance, N. These quantities were assumed constant for a single prob- 
lem but could change from problem to problem. Suppose now that one or 
both of these quantities changed during the problem, say at time k equal 
to ten. The optimal gain schedule for such a system might be as shown in 
Fig. 7. In a situation such as this the Kalman gain schedule would have 
to be computed on-line to maintain optimality if the change time were not 
known a priori. In Fig. 8 a plot is shown of the reaction of the closed- 
form approximations to such a situation. Although the sub-optimal gains 
are still non-optimal, they follow the general trend of the optimal gains, 
and hence may be used in their stead. 

The arguments presented above would indicate that substantial savings 
in time and space could be realized at little cost in performance if the 
closed-form approximations for the gain matrix were used in place of the 
Kalman recursive solution. 

An inspection of Fig. 4 and Fig. 5 reveals that the results obtained 
by the specific optimal estimation technique offered by Sims and Melsa 
are more near-optimal than those obtained by the method discussed in this 
paper. This fact brings out the major difference between these two methods. 
In this study the gain matrix was constrained to be an exponential, the 
parameters of which were determined by geometric means. That is, the 
parameters of the exponential were determined by requiring that the ex- 
ponential be a geometric least-squares fit to the Kalman filter optimal- 
gain matrix. In contrast the parameters of the constant-gain matrix of 
the specific optimal estimator were determined by minimizing errors in 
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filter performance. It is significant to note that the constant gains 
employed in the Sims/Melsa method gave better performance than the ex- 
ponential gains of the geometric fit method. One might speculate that the 
assumption of an exponential form in the former method might even more 
closely match the optimal filter performance. 
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VII. SUMMARY 



This study has illustrated that a closed-form analytic approximation 
to the filter gain matrix for an optimal Kalman filter can be obtained 
which will reduce the computation time while procuding near-optimal esti- 
mates. This method would be useful in problems where computation time and 
storage space were limited. This method has compared favorably with both 
the optimal filter and the specific optimal estimator with which it was 
compared. 
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APPENDIX A 



METHOD OF LEAST SQUARES 



The most probable value of a quantity which is obtained from a set of 
observations is the one which corresponds to the most probable set of 
errors of observation. These errors are known as residuals. Consider 
a set of n observations of equal precision, the mose probable errors of 
which are x^, X 2 > x^.-.x^, respectively. Since the probability of the 
simultaneous occurrence of several events in a series is the product of 
their individual probabilities, and the probability of an error, x, is 




*2 2 
-h x 



( 2 . 1 ) 



it follows that the probability of the simultaneous occurrence of the 
errors x-^, X 2 > x^-.-x^ will be 



P = 



h -h^x^ 


h -h 2 x 2 


fh - h 2x 2 " 


1 


jfi? 6 2_ 


' * * |_*? 6 n _ 



that is 




2 2 2 2 2 

a -h (x x x . . .x ) 
12 3 n 



( 2 . 2 ) 



Since h, n, , and e are constants in a given problem the quantity P is 
a maximum when the exponent of e is a maximum, or when the sum 

2 2 2 2 

x x x . . .x is a minimum. (2.3) 

1 2 3 n 



Thus, the most probably value of the observed quantity, or the best value, 
in other words, obtainable from the given set of observations, will be one 
for which the sum of the squares of the residuals is a minimum. This is 
called the Principle of Least Squares. 
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The Principle of Least Squares has been used extensively to formulate 



computer programs for determining the coefficients of a linear equation 
which is a best fit, in the Least-Square sense, to observed data. In 
general, equations of higher than first degree can be reduced to linear 
form by developing the function by Taylor f s Theorem and neglecting the 
squares, products, and higher powers of the small increments involved. 

Equations in which the unknown constant occurs as an exponent con- 
stitute a special case of reduction to linear form. In brief, the method 
is to throw the equation into the logarithmic form by taking the logarithm 
of each member. The resulting function will be linear with respect to 
the desired coefficient. Suppose the function is of the form 



y 



= ae 



bt 



(2.4) 



in which a and b are to be determined so as to fit all to the observa- 
tions as well as possible. Taking the logarithm of each member gives 

log y * log a + bt, (2.5) 



which is the linear form of 



y f = A + bt, (2.6) 

where A and b are the unknown constants. By simply taking the inverse 
logarithm of the coefficient A the Least Squares fit curve of exponential 
form can be obtained. 
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APPENDIX B 



SUB-OPTIMAL GAIN EQUATIONS 



G (2 , l) k = Ae~* k + 2e~- ° k 01 + A 


(4.1) 


G(l,l) k = Ce"^ k + D 


(4.2) 


ratio = N/R 


(4.3) 


E - e- 4325 
ratio 


(4.4) 


.6841 

D - e" . 

ratio 


(4.5) 


A = 2 - E 


(4.6) 


C = 1 - D 


(4.7) 


0 -.5383(ratio) 
<sC = 2e 


(4.8) 


7382 

ft " e ratio 


(4.9) 
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